Skip to content

feat: add bug-triage Claude skill#4109

Merged
andygrove merged 5 commits into
apache:mainfrom
andygrove:bug-triage-skill
May 4, 2026
Merged

feat: add bug-triage Claude skill#4109
andygrove merged 5 commits into
apache:mainfrom
andygrove:bug-triage-skill

Conversation

@andygrove
Copy link
Copy Markdown
Member

Which issue does this PR close?

Closes #.

Rationale for this change

We have a bug triage guide at docs/source/contributor-guide/bug_triage.md but no automated way to work through the backlog of issues labeled requires-triage. This adds a Claude skill that does the triage pass against the guide and produces an audit trail.

What changes are included in this PR?

A new .claude/skills/bug-triage/SKILL.md that:

  • Reads docs/source/contributor-guide/bug_triage.md as the source of truth for priority, area labels, and escalation rules
  • Lists open issues labeled requires-triage
  • For each issue it can confidently classify, applies the recommended priority, area labels, and good first issue (where appropriate) and removes requires-triage
  • Skips issues that are too ambiguous (no repro, etc.) and leaves requires-triage intact on them so they show up in the next pass
  • Files a single dated summary issue (Bug triage results: YYYY-MM-DD) recording every decision plus skipped and failed entries, for a human reviewer to spot-check and close

The skill is explicit about what it must not do: no inventing labels, no commenting on triaged issues, no closing issues, no AI attribution in the summary.

How are these changes tested?

No automated tests. This is a Claude skill (markdown instructions); behavior is exercised by invoking the skill against the live apache/datafusion-comet issue list. The summary issue created by each run is itself the human-reviewable artifact.

Adds a Claude skill that reads the project bug triage guide, classifies open requires-triage issues, and files a dated summary issue with recommended priority and area labels for a human to review and apply.
Reverses the earlier read-only behavior. The skill now applies the recommended priority and area labels and removes requires-triage; the dated summary issue records what was done so a human reviewer can spot-check and close it.
Comment thread .claude/skills/bug-triage/SKILL.md Outdated
For each issue, review the title and body and determine:

1. **Priority label** (exactly one): apply the decision tree from the guide.
- `priority:critical` if it could produce silent wrong results
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we say correctness issues?

what about security issues?

Comment thread .claude/skills/bug-triage/SKILL.md Outdated
1. **Priority label** (exactly one): apply the decision tree from the guide.
- `priority:critical` if it could produce silent wrong results
- `priority:high` for crashes, panics, segfaults, NPEs on supported paths
- `priority:medium` for functional bugs / perf regressions with workarounds
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- `priority:medium` for functional bugs / perf regressions with workarounds
- `priority:medium` for functional bugs / performance regressions with workarounds

andygrove added 2 commits May 4, 2026 07:13
Summary issue body now uses one subsection per priority, ordered highest
first, with one bullet per issue (title plus linked number) and
sub-bullets for area labels, good-first-issue flag, and rationale. Drops
the markdown table form.

Also folds in PR review feedback: priority:critical now explicitly
covers correctness issues and security vulnerabilities, and
"perf regressions" is spelled out as "performance regressions".
@andygrove
Copy link
Copy Markdown
Member Author

Thanks for review @comphead. I addressed feedback and made other improvements such as listing by priority, showing issue titles, using bullets instead of markdown table

@andygrove
Copy link
Copy Markdown
Member Author

Latest triage issue created with this skill:
#4203

Copy link
Copy Markdown
Contributor

@coderfender coderfender left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ! Perhaps we could keep fine tuning it based on the results / experience in the next few weeks ?

@andygrove
Copy link
Copy Markdown
Member Author

LGTM ! Perhaps we could keep fine tuning it based on the results / experience in the next few weeks ?

Absolutely. Once this one is merged, anyone can create PRs to improve as needed. Thanks for the approval @coderfender

@andygrove andygrove merged commit 6bfc865 into apache:main May 4, 2026
5 checks passed
@andygrove andygrove deleted the bug-triage-skill branch May 4, 2026 16:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants